Information processing apparatus, information processing method, and program

ABSTRACT

An information processing apparatus includes a sensor, a storage section, and a controller. The sensor includes an input surface for accepting an input operation of a user using a writing tool and is capable of detecting coordinates of a position at which the input operation is made and a weight applied to the position. The controller is capable of causing the storage section to store, at predetermined time intervals, coordinate data indicating the detected coordinates and weight data indicating the weight in association with identification information of the user, and reading out the stored coordinate data and weight data from the storage section in association with the identification information.

TECHNICAL FIELD

The present technique relates to an information processing apparatusincluding a touch sensor, and an information processing method and aprogram for the information processing apparatus.

BACKGROUND ART

From the past, information processing apparatuses with each of which auser is capable of performing an input operation on a screen using awriting tool such as a stylus (hereinafter, referred to as pen input)via a touch panel or a touch pad are put to practical use (see, forexample, Patent Document 1). The pen input is realized by detecting aposition of a pen and displaying an image on a display apparatus basedon detection data.

Patent Document 1: Japanese Patent Application Laid-open No. 2012-168993

SUMMARY OF INVENTION Problem to be Solved by the Invention

The pen input technique of the related art as described above isspecialized in displaying input results of letters and line arts in realtime. However, if the information processing apparatus can stably andaccurately detect not only a position of the pen on the screen but alsoa pressing force of the pen, it becomes possible to record more specificfeatures at a time of a pen input of each user, such as a writingpressure and a brushwork, in addition to a handwriting. The feature datacan then be used in various applications.

In view of the circumstances as described above, the present techniqueaims at providing an information processing apparatus capable ofrecording, for each user, specific features at a time of an input usinga writing tool and utilizing them, and an information processing methodand a program for the information processing apparatus.

Means for Solving the Problem

To attain the object described above, according to an embodiment of thepresent technique, there is provided an information processing apparatusincluding a sensor, a storage section, and a controller. The sensorincludes an input surface for accepting an input operation of a userusing a writing tool and is capable of detecting coordinates of aposition at which the input operation is made and a weight applied tothe position. The controller is capable of causing the storage sectionto store, at predetermined time intervals, coordinate data indicatingthe detected coordinates and weight data indicating the weight inassociation with identification information of the user, and reading outthe stored coordinate data and weight data from the storage section inassociation with the identification information.

With this structure, since the information processing apparatus candetect not only the coordinate data at the time an input operation ismade to the sensor using the writing tool but also the weight data,specific features obtained at the time the input operation is made usingthe writing tool can be recorded for each user and utilized. Here,examples of the writing tool include various tools with which a writingoperation can be made irrespective of the shape or the use of inks, suchas a stylus, a pen, and an ink brush.

The controller may be capable of calculating movement velocity dataindicating a movement velocity of the coordinates from the coordinatedata stored at the predetermined time intervals.

Accordingly, by also calculating the movement velocity data in additionto the coordinate data and the weight data, the information processingapparatus can more specifically record the features at the time theinput operation is made and utilize them.

The controller may be capable of calculating weight change dataindicating a temporal change of the weight from the weight data storedat the predetermined time intervals.

Accordingly, by also calculating the weight change data in addition tothe coordinate data and the weight data, the information processingapparatus can more specifically record the features at the time theinput operation is made and utilize them.

The controller may be capable of comparing the coordinates and theweight detected from an input operation made using the writing toolafter the coordinate data and the weight data are stored, with thestored coordinate data and weight data and judging whether there is adifference.

Accordingly, the information processing apparatus can judge a differencein the features of input operations made by different users based on thecoordinate data and the weight data.

The controller may be capable of authenticating the user based on thejudgment on whether there is a difference and outputting anauthentication result.

Accordingly, the information processing apparatus can perform individualauthentications based on the difference in the coordinate data and theweight data.

The information processing apparatus may further include a displaysection. In this case, the controller may be capable of controlling thedisplay section to display, based on the input operation, an imageshowing a trajectory from a start to an end of the input operation usingonly the coordinate data out of the coordinate data and the weight data.

Accordingly, while both the coordinate data and the weight data are usedin the authentication processing in the information processingapparatus, by not reflecting the weight data onto an image as a resultof the input operation of the user, it can be made difficult for acopier to copy input operations of other users including weights.

The information processing apparatus may further include an outputsection. In this case, the controller may be capable of controlling theoutput section to output information indicating the judged difference.

Accordingly, the information processing apparatus can notify the user ofa difference in the operation inputs based on the difference in thecoordinate data and the weight data.

The information processing apparatus may further include a displaysection. In this case, the controller may be capable of controlling thedisplay section to display, based on the stored coordinate data andweight data, a first image that shows a trajectory from a start to anend of the input operation of the user.

Accordingly, other users that have performed operation inputs after thecoordinate data and the weight data are stored can reference thetrajectory of the operation input of the user for which the coordinatedata and the weight data are stored as their own examples, for example.

The sensor may be capable of detecting, after the display of the image,coordinate data and weight data from an input operation made by anotheruser using the writing tool. In this case, the controller may be capableof controlling the display section to display, based on the detectedcoordinate data and weight data, a second image that shows a trajectoryfrom a start to an end of the input operation of the another user whilesuperimposing the second image on the first image. The controller mayalso be capable of comparing the stored coordinate data and weight datawith the coordinate data and the weight data detected from the inputoperation of the another user, and controlling the display section todisplay information indicating a difference between the first image andthe second image.

Accordingly, by displaying the first image based on the storedcoordinate data and weight data and notifying the user of the differencebetween the first image and the second image drawn by another user, theinformation processing apparatus can assist technical improvements inpen writing, calligraphy, painting, and the like.

The controller may change a line width or shading of the first image andthe second image according to the stored weight data and the weight datadetected from the input operation of the another user.

Accordingly, the information processing apparatus can express specificfeatures such as a writing pressure of each user by the line width orshading in the first image and the second image to more specificallynotify the difference between the images.

The sensor may be capable of detecting, when a hand of the user touchesthe input surface at a time the user makes the input operation using thewriting tool, coordinates of the contact position and a weight appliedto the contact position. In this case, the controller may cause thestorage section to store coordinate data indicating the detectedcoordinates of the contact position and weight data indicating theweight applied to the contact position in association with thecoordinate data and the weight data, that have been detected from theinput operation, and the identification information.

Accordingly, by recording not only the features of the user in the inputoperation of the user using the writing tool but also a feature relatedto how a hand of the user is placed during the input operation, theinformation processing apparatus can more specifically record thefeatures of the user.

The information processing apparatus may further include a communicationsection. In this case, the controller may control the communicationsection to transmit the stored coordinate data and weight data toanother information processing apparatus. The another informationprocessing apparatus may display an image that shows a trajectory from astart to an end of the input operation of the user based on thetransmitted coordinate data and weight data.

Accordingly, the information processing apparatus can reproduce theinput operation of the user using the writing tool in other informationprocessing apparatuses.

According to another embodiment of the present technique, there isprovided an information processing method including: detecting, by asensor including an input surface for accepting an input operation of auser using a writing tool, coordinates of a position at which the inputoperation is made and a weight applied to the position; storing, by astorage section, at predetermined time intervals, coordinate dataindicating the detected coordinates and weight data indicating theweight in association with identification information of the user; andreading out the stored coordinate data and weight data from the storagesection in association with the identification information.

According to another embodiment of the present technique, there isprovided a program that causes an information processing apparatus toexecute a detection step, a storage step, and a reading step. Thedetection step includes detecting, by a sensor including an inputsurface for accepting an input operation of a user using a writing tool,coordinates of a position at which the input operation is made and aweight applied to the position. The storage step includes storing, by astorage section, at predetermined time intervals, coordinate dataindicating the detected coordinates and weight data indicating theweight in association with identification information of the user. Thereading step includes reading out the stored coordinate data and weightdata from the storage section in association with the identificationinformation.

Effect of the Invention

As described above, according to the present technique, specificfeatures obtained at a time an input is made using a writing tool can berecorded for each user and utilized.

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1 A diagram showing an outer appearance of a tablet computeraccording to a first embodiment of the present technique.

FIG. 2 A block diagram showing a structure of the tablet computer.

FIG. 3 A schematic cross-sectional diagram of an input apparatusincluded in the tablet computer.

FIG. 4 Diagrams for explaining calculation processing of coordinatedata, weight data, movement velocity data, and temporal weight changedata by the tablet computer.

FIG. 5 A flowchart showing a flow of individual authenticationprocessing by the tablet computer.

FIG. 6 A diagram for explaining examples of pen operations made bydifferent users and processing of comparing them in the first embodimentof the present technique.

FIG. 7 A diagram for explaining processing of discriminating a copier ofa pen operation of a certain user in the first embodiment of the presenttechnique.

FIG. 8 A diagram showing a picture drawing operation of a certain userand reproduction processing based on recording data of the drawingoperation according to a second embodiment of the present technique.

FIG. 9 A diagram showing a reproduction example of the drawing operationthat uses various types of recording data in the second embodiment ofthe present technique.

FIG. 10 A diagram showing a flow of operations of the tablet computer ata time of executing a picture or calligraphy learning application in thesecond embodiment of the present technique.

FIG. 11 A diagram showing a flow of processing of the picture orcalligraphy learning application.

MODES FOR CARRYING OUT THE INVENTION

Hereinafter, embodiments of the present technique will be described withreference to the drawings.

First Embodiment

First, a first embodiment of the present technique will be described. Inthis embodiment, the present technique is applied to a tablet computer.The tablet computer is used in a system that requires an authenticationby a signature for settlements in shops and websites, various proceduresin banks, and the like, for example. The tablet computer may bepossessed by a user or by a shop or the like.

[Structure of Tablet Computer]

FIG. 1 is a diagram showing an outer appearance of a tablet computer 100(hereinafter, simply referred to as tablet 100) of this embodiment. FIG.2 is a block diagram showing a structure of the tablet 100.

As shown in FIG. 1, the tablet 100 includes an input apparatus 150 thataccepts an input operation made using a writing tool such as a stylus S(hereinafter, also referred to as pen operation).

The input apparatus 150 has a structure in which a sensor 1 to bedescribed later and a display 6 that displays letters and images basedon pen operations are integrated. When a pen operation is made on aninput screen of the display 6, an image I is displayed on the display 6along a trajectory T of a tip end position of the stylus S.

As shown in FIG. 2, the tablet 100 includes the sensor 1, a sensor IC 2,a CPU (Central Processing Unit) 3, a memory 4, a graphic driver 5, andthe display 6. As described above, the input apparatus 150 isconstituted of the sensor 1 and the display 6. The specific structure ofthe input apparatus 150 will be described later.

The sensor IC 2 receives sensor data detected by the sensor 1 atpredetermined time intervals and calculates coordinate data and weightdata of the stylus S based on the sensor data. The sensor IC alsocalculates data indicating a movement velocity of the coordinates of thestylus S from the coordinate data obtained at the predetermined timeintervals and calculates data indicating a temporal weight change(hereinafter, also referred to as weight change data) from the weightdata obtained at the predetermined time intervals. The calculated piecesof data are output to the CPU 3.

The CPU 3 writes the sensing data output from the sensor IC 2 in thememory 4 and reads out the written data from the memory 4 asappropriate. At this time, the data is recorded in association with auser that has made the pen operation. Then, the CPU 3 determines a datadisplay method for the display 6 based on the sensing data output fromthe sensor IC 2 or read out from the memory 4 and instructs the graphicdriver 5 to display.

The memory 4 stores the sensing data as input operation data of eachuser. The memory 4 also stores other data such as programs requisite foraccepting a pen operation, reproducing pen operation data, and the like.

The graphic driver 5 generates an image corresponding to a pen operation(image showing trajectory of stylus S, etc.) based on the displayinstruction from the CPU 3 and outputs it to the display 6 for display.

Although not shown, the tablet 100 may also include a communicationsection for communicating with other information processing apparatusesin a wireless or wired manner.

[Structure of Input Apparatus]

Next, the structure of the input apparatus 150 will be described. FIG. 3is a schematic cross-sectional diagram of the input apparatus 150. Asshown in the figure, the input apparatus 150 includes the display 6 thataccepts pen operations and the sensor 1 that detects user operations.The input apparatus 150 is structured as a flexible touch panel display,for example, and is incorporated into the tablet 100. The sensor 1 andthe display 6 are each formed as a plate extending in a directionvertical to a Z axis.

The display 6 includes a first surface 110 and a second surface 120 onthe other side of the first surface 110. The display 6 has both afunction as an input operation section and a function as a displaysection in the input apparatus 150. Specifically, the display 6 causesthe first surface 110 to function as an input operation surface and adisplay surface and displays an image corresponding to a user operationupwardly in the Z-axis direction from the first surface 110. Displayedon the first surface 110 are letters written by a user or an image drawnby a user using the stylus S, an image corresponding to a keyboard, aGUI (Graphical User Interface), and the like.

The specific structure of the display 6 is not limited in particular.For example, as the display 6, a so-called electronic paper, an organicEL (Electro Luminescence) panel, an inorganic EL panel, a liquid crystalpanel, or the like may be used. The thickness of the display 6 is notlimited in particular and is, for example, about 0.1 mm to 1 mm.

The sensor 1 includes a metal film (first conductive layer) 12, aconductive layer (second conductive layer) 50, an electrode substrate20, a first supporting body 30, and a second supporting body 40. Thesensor 1 is arranged on the second surface 120 side of the display 6.

The metal film 12 has a deformable sheet-like structure. The conductivelayer 50 opposes the metal film 12. The electrode substrate 20 includesa plurality of first electrode lines 210 and a plurality of secondelectrode lines 220 that oppose the plurality of first electrode lines210 and intersect the plurality of first electrode lines 210, isarranged while being deformable between the metal film 12 and theconductive layer 50, and is capable of statically detecting a distancechange with respect to each of the metal film 12 and the conductivelayer 50. The first supporting body 30 includes a plurality of firststructures 310 that connect the metal film 12 and the electrodesubstrate 20 and first spatial sections 330 formed among the pluralityof first structures 310. The second supporting body 40 includes aplurality of second structures 410 that are each provided between theplurality of adjacent first structures 310 and connect the conductivelayer 50 and the electrode substrate 20 and second spatial sections 430formed among the plurality of second structures 410.

The sensor 1 (input apparatus 150) of this embodiment statically detectsa change of a distance between the metal film 12 and the electrodesubstrate 20 and a change of a distance between the conductive layer 50and the electrode substrate 20 due to an input operation made on thefirst surface 110 of the display 6, to detect coordinates of a positionat which the input operation is made and a weight applied to thatposition. A specific detection principle is as follows.

Specifically, the metal film 12 is bent by a pressing force caused at atime an input operation is made on the first surface 110 by the stylusS. Accompanying this, the first structures 310 adjacent to the firstspatial sections 330 receive the force to be elastically deformed in theZ-axis direction, and the thickness slightly reduces. Furthermore, aforce is also applied to the electrode substrate 20 by the force to bendit downwardly. As a result, the second structure 410 arranged betweenthe two first structures 310 is also applied with the force so as to beelastically deformed in the Z-axis direction, and the thickness slightlyreduces.

As described above, the force can be transmitted in the thicknessdirection by the first and second structures 310 and 410, and theelectrode substrate 20 can be deformed with ease. Moreover, since themetal film 12 and the electrode substrate 20 are bent and an influenceof the pressing force reaches the in-plane direction (direction parallelto X- and Y-axis directions), the force influences not only an areaimmediately below the stylus S but also the first and second structures310 and 410 in the vicinity thereof.

Further, the metal film 12 and the electrode substrate 20 can be easilydeformed by the first and second spatial sections 330 and 430.Furthermore, by the first and second structures 310 and 410 having acylindrical structure or the like, a high pressure can be applied to theelectrode substrate 20 with respect to the pressing force of the stylusS, and the electrode substrate 20 can therefore be bent efficiently.

In addition, since the first and second structures 310 and 410 do notoverlap one another in the Z-axis direction, the first structures 310can cause the electrode substrate 20 to be bent easily via the secondspatial sections 430 below them.

The electrode substrate 20 can obtain a capacitance change amount bydetecting changes in the distance between the metal film 12 and theelectrode substrate 20 and the distance between the conductive layer 50and the electrode substrate 20 due to the elastic deformation of thefirst structures 310 and the bending of the metal film 12.

The electrode substrate 20 can calculate XY coordinates of a penoperation position (tip end position of stylus S) based on a ratio ofthe capacitance change amounts at the respective positions of theplurality of first electrode lines 210 and the plurality of secondelectrode lines 220. The electrode substrate 20 can also calculate theweight (pressing force) at the input operation position based on thecapacitance change amounts.

[Tablet Operation]

Next, operations of the tablet 100 structured as described above will bedescribed. In this and subsequent embodiments, the operations of thetablet 100 are carried out in cooperation with the CPU 3 and softwareexecuted under control of the CPU 3.

(Data Acquisition/Calculation Processing)

First, processing of acquiring and calculating the coordinate data,weight data, movement velocity data, and weight change data will bedescribed. FIG. 4 are diagrams for explaining the processing ofcalculating the data.

FIG. 4(A) shows the processing of calculating the coordinate data andweight data. The sensor 1 outputs, while a user is performing a penoperation, coordinate data ((Xt1, Yt1), (Xt2, Yt2), . . . , (Xtn, Ytn))and weight data (Ft1, Ft2, . . . , Ftn) at a contact position of thestylus S at predetermined time intervals, and the CPU 3 writes thosedata in the memory 4 as necessary.

FIG. 4(B) shows the processing of calculating the movement velocity dataand weight change data. The sensor IC 2 calculates the movement velocitydata from a difference in the coordinate data per unit time Δt((Xt2−Xt1)/Δt, (Yt2−Yt1)/Δt), and calculates the weight change data froma difference in the weight data per unit time Δt ((Ft2−Ft1)/Δt). The CPU3 also writes those data in the memory 4 as necessary.

(Individual Authentication Operation Based on Recording Data)

Next, individual authentication processing based on the recorded datawill be described. FIG. 5 is a flowchart showing a flow of theindividual authentication processing. In the descriptions below, the CPU3 is described as an operation subject. However, the operation isexecuted in cooperation with other hardware such as the sensor 1, thesensor IC 2, and the memory 4 and related software.

As shown in the figure, the CPU 3 of the tablet 100 accepts a penoperation of a user A using the stylus S (Step 51). The pen operation isan operation for inputting a signature that is performed at a time of acredit card settlement, at a time of login to a computer or a network,and the like, for example. The signature includes any letter, figure, orthe like that has been written for identifying an individual in additionto a correct name.

Subsequently, the CPU 3 detects coordinates at which the pen operationis made and a weight applied to the position (Step 52). At this time,the CPU 3 causes the display 6 to display a trajectory of the penoperation as shown in FIG. 1. However, the display processing may beomitted.

Then, the CPU 3 records the coordinate data and the weight data in thememory 4 in association with the user A as the operation subject (Step53).

Next, the CPU 3 calculates movement velocity data and weight change datafrom the coordinate data and the weight data, respectively, (Step 54)and records those data in the memory 4 in association with the user A(Step 55). The processing up to this point becomes recording processingof input operation data of the user A using the stylus S.

Subsequently, the CPU 3 shifts to the authentication processing thatutilizes the recorded input operation. The CPU 3 accepts a pen operationof a user B (irrespective of whether he/she is different person fromuser A) using the stylus S.

Then, the CPU 3 detects coordinates and a weight of the input operationposition of the user B (Step 57).

After that, the CPU 3 calculates movement velocity data and weightchange data at the coordinates from the coordinate data and the weightdata (Step 58).

Then, the CPU 3 reads out the recorded input operation data of the userA from the memory 4, compares it with the input operation data of theuser B, and judges a difference between those data (Step 59).

Then, when there is a difference as a result of the comparison (Yes inStep 60), the CPU 3 causes the display 6 to display information fornotifying an authentication failure (Step 61).

On the other hand, when there is no difference or there is a minutedifference (No in Step 60), the CPU 3 causes the display 6 to displayinformation for notifying an authentication success (Step 62).

FIG. 6 is a diagram for explaining examples of the pen operations madeby the users A and B and the processing of comparing them.

As shown in the figure, in a case where processing of changing a linewidth or the like is not carried out on a display image as a penoperation result, for example, regarding a habit of the user A inputting a force (weight) during a pen operation, the habit of the usercannot be discriminated from the display image (see upper portion offigure).

However, since the habit of the user regarding a degree of a force isrecorded as weight data in the recording data of the pen operation inthis embodiment, by comparing the recording data with a degree of aforce of the user B, it becomes possible to raise an individualauthentication rate (see lower portion of figure). On the other hand, byexpressing a display image by lines of equal widths and not reflectingthe degree of a force, it becomes difficult to copy the pen operation ofthe user A including the degree of a force even if the user B looks atthe image (signature) showing the pen operation of the user A.

FIG. 7 is a diagram for explaining processing of discriminating a copiercopying a pen operation of the user A.

As shown in the figure, regarding a habit of the stylus S on a movementvelocity during a pen operation of the user A, since a difference in themovement velocity is not expressed in the display image as the penoperation result, the copier cannot grasp the habit of the user A fromthe display image. On the other hand, since the habit of the user A onthe velocity is recorded as the movement velocity data in the recordingdata of the pen operation, by comparing the movement velocity data, itbecomes possible to raise the individual authentication rate. Moreover,by not reflecting the velocity on the display image, it becomesdifficult for the copier to copy the pen operation of the user Aincluding the velocity.

As described above, in this embodiment, by recording the pen operationof the user as coordinate data, weight data, movement velocity data, andweight change data by the sensor 1 capable of detecting coordinate dataand weight data, the tablet 100 can execute the individualauthentication processing depending on recording contents.

Second Embodiment

Next, a second embodiment of the present technique will be described. Inthis embodiment, descriptions on points that are common with the firstembodiment will be simplified or omitted, and different points willmainly be described.

The first embodiment has described the example where the tablet 100executes the individual authentication processing based on recorded penoperation data. In this embodiment, the tablet 100 executes, based onrecorded pen operation data, an application with which a correcthandwriting or picture drawing can be learned.

While the stylus S has been used for an input operation in the firstembodiment, other writing tools such as an ink brush for calligraphy andan ink brush for drawing may be used in addition to the stylus in thisembodiment.

FIG. 8 is a diagram showing a picture drawing operation of a certainuser and reproduction processing based on recording data of the drawingoperation.

As shown in the figure, when a certain user inputs a drawing operation,a drawing result is displayed on the display 6, and coordinate data,weight data, movement velocity data, and weight change data obtainedduring the operation are recorded in the memory 4 (see upper portion andcenter portion of figure). In the processing of displaying the drawingresult, a line width is changed according to the weight data.

Subsequently, a drawing operation is reproduced using the recordeddrawing operation data (see lower portion of figure). The reproductionprocessing is fundamentally different from the reproduction processingbased on recording data of the related art in the point of using thedrawing operation data (re-drawing processing).

At this time, as shown in the figure, the tablet 100 may change thevelocity in the reproduction processing from the velocity during therecording.

FIG. 9 is a diagram showing another example of the reproductionprocessing that uses the drawing operation data.

As shown in the upper portion of the figure, the tablet 100 mayreproduce a drawing operation using only coordinate data out of thedrawing operation data. Alternatively, as shown in the lower portion ofthe figure, the tablet 100 may reproduce the drawing operation whileexpressing weight data as shading in addition to the coordinate data.

Alternatively, the tablet 100 may change the line width or color used inthe drawing or sequentially reproduce a plurality of pieces of recordingdata.

An apparatus used when recording the drawing operation (tablet) and anapparatus used for the reproduction (tablet) may be differentapparatuses. In other words, drawing operation data recorded in acertain apparatus may be transmitted to and reproduced in anotherapparatus.

Typically, a solution of recording drawing data of a prominent artist,calligrapher, and the like in advance, and storing the data in thetablet 100 via a server on the Internet or in a preinstall form, forexample, so that a user learns painting or calligraphy based on thedrawing data is conceivable.

Further, a solution in which a user records a letter or picturewritten/drawn by him/herself in the tablet 100 as drawing history dataso as to review it for learning later on is also possible.

Furthermore, in this embodiment, a learning (education) application thatrecords in real time, while a drawing operation of the user A is beingreproduced using recording data, a drawing operation obtained as aresult of the other user B copying the drawing operation of the user A,and compares the recording data of the user A and the recording data ofthe user B is also executable.

FIG. 10 is a diagram showing a flow of operations of the tablet computerat a time of executing the learning application. Further, FIG. 11 is adiagram showing a flow of processing of the learning application.

As shown in FIG. 10, the CPU 3 of the tablet 100 first accepts a drawingoperation input of the user A (Step 101).

Next, the CPU 3 detects coordinates of an input position of the drawingoperation and a weight applied to the input position (Step 102) andrecords the coordinate data and the weight data in association with theuser A (Step 103). At this time, an image showing a trajectory from astart to an end of the drawing operation of the user A is displayed onthe display 6 (see upper portion of FIG. 11).

Subsequently, the CPU 3 calculates the movement velocity data and theweight change data from the coordinate data and the weight data,respectively, (Step 104) and records the data in the memory 4 inassociation with the user A (Step 105).

Then, the CPU 3 judges whether a reproduction instruction has been givenregarding a drawing operation of the user A (Step 106).

When the reproduction instruction has been given (Yes), the CPU 3reproduces the drawing operation of the user A on the display 6 based onthe recording data (Step 107). At the same time, the CPU 3 accepts adrawing operation of the user B in which the user B traces the drawingoperation of the user A that has been reproduced or that is beingreproduced (Step 108) (see center portion of FIG. 11).

Subsequently, the CPU 3 detects coordinates and a weight regarding thedrawing operation of the user B (Step 109) and records coordinate dataand weight data in the memory 4 in association with the user B (Step110).

Then, the CPU 3 calculates movement velocity data and weight change datafrom the coordinate data and the weight data, respectively, (Step 111)and records the data in the memory 4 in association with the user B(Step 112).

Subsequently, the CPU 3 compares the drawing operation data of the userA and the drawing operation data of the user B that have been recordedand judges a difference between them (Step 113).

Then, the CPU 3 generates information indicating the difference anddisplays the information on the display 6 while superimposing it on thereproduced drawing operation data of the user A (Step 114).

For example, when the weight data of the user B is smaller than theweight data of the user A at a certain position as shown in the lowerportion of FIG. 11, that is, a force of the user B is insufficient, amessage “strongly” may be displayed while pointing that position.Moreover, when there is a deviation between the coordinate data of theuser A and the coordinate data of the user B, a message “correctly” maybe displayed while pointing that position. In addition, when a drawingvelocity of the user B is slow or there is unevenness in the weight, forexample, a message indicating the fact may be displayed.

As described above, according to this embodiment, the tablet 100 cannotify the user B of a difference between the drawing operation of theuser A and the drawing operation of the user B. As a result, the user Bcan grasp differences in brushworks, forces in using an ink brush, andthe like in ink brush drawing, for example. In other words, the user Bcan practice to attain the drawing performance of the user A as anexample. Such an application may be used by individual users or ineducational institutions such as schools.

Modified Example

The present technique is not limited to the embodiments above and may bevariously modified without departing from the gist of the presenttechnique.

Although the sensor 1 detects only an input operation using the writingtool in the embodiments above, the sensor 1 is of course also capable ofdetecting an operation using a finger of a user and the like, forexample. The sensor 1 is also capable of detecting coordinates and aweight of a hand of a user that touches the first surface 110 of thedisplay 6 at a time an input operation is made using a writing tool.Accordingly, by also recording the way a hand of a user is placed duringa pen operation as a feature of the user, for example, the tablet 100can raise the authentication rate in the individual authenticationprocessing and provide a more specific example in the learningapplication.

The embodiments above have described the examples of utilizing recordingdata obtained during an input operation in the authentication processingand the learning application, but the recording data can also beutilized in various other solutions.

For example, if coordinate data and weight data on a keyboard or a drumare recorded when a certain user plays a piano or a drum, those data canbe utilized in a performance learning application.

Further, by also recording drawing operation data when an artist such asa painter newly produces an art work, when a fake of that art workappears later on, the fake can be detected by comparing drawingoperation data of that fake if the drawing operation data thereofexists.

Although the drawing operation data has been used in the learningapplication in the second embodiment above, it is also possible tocreate values in the drawing operation data itself. For example, drawingdata of an artist may be downloaded via the Internet or the like basedon a user request. Accordingly, since the data is not only data as adrawing result but also data including subtle brushworks and the like ofthe artist, various applications are possible, and a high value as aproduct can be imparted.

Although the movement velocity data and weight change data have beenused in various types of processing in addition to the coordinate dataand weight data in the embodiments above, at least one of the coordinatedata, weight data, movement velocity data, and weight change data may beused selectively for the authentication processing and reproductionprocessing as necessary.

The embodiments above have described the example where the presenttechnique is applied to a tablet computer. However, the presenttechnique is also applicable to various information processingapparatuses onto which a touch sensor can be mounted, such as a laptopPC, a smartphone, a PDA (Personal Digital Assistant), an electronic bookreader, a portable player, and a car navigation system.

[Others]

The present technique may also take the following structures.

-   (1) An information processing apparatus, including:

a sensor that includes an input surface for accepting an input operationof a user using a writing tool and is capable of detecting coordinatesof a position at which the input operation is made and a weight appliedto the position;

a storage section; and

a controller capable of causing the storage section to store, atpredetermined time intervals, coordinate data indicating the detectedcoordinates and weight data indicating the weight in association withidentification information of the user, and reading out the storedcoordinate data and weight data from the storage section in associationwith the identification information.

-   (2) The information processing apparatus according to (1) above,

in which the controller is capable of calculating movement velocity dataindicating a movement velocity of the coordinates from the coordinatedata stored at the predetermined time intervals.

-   (3) The information processing apparatus according to (1) or (2)    above,

in which the controller is capable of calculating weight change dataindicating a temporal change of the weight from the weight data storedat the predetermined time intervals.

-   (4) The information processing apparatus according to any one of (1)    to (3) above,

in which the controller is capable of comparing the coordinates and theweight detected from an input operation made using the writing toolafter the coordinate data and the weight data are stored, with thestored coordinate data and weight data and judging whether there is adifference.

-   (5) The information processing apparatus according to (4) above,

in which the controller is capable of authenticating the user based onthe judgment on whether there is a difference and outputting anauthentication result.

-   (6) The information processing apparatus according to (5) above,    further including

a display section,

in which the controller is capable of controlling the display section todisplay, based on the input operation, an image showing a trajectoryfrom a start to an end of the input operation using only the coordinatedata out of the coordinate data and the weight data.

-   (7) The information processing apparatus according to any one of (1)    to (6) above, further including

an output section,

in which the controller is capable of controlling the output section tooutput information indicating the judged difference.

-   (8) The information processing apparatus according to any one of (1)    to (7) above, further including

a display section,

in which the controller is capable of controlling the display section todisplay, based on the stored coordinate data and weight data, a firstimage that shows a trajectory from a start to an end of the inputoperation of the user.

-   (9) The information processing apparatus according to (8) above,

in which the sensor is capable of detecting, after the display of theimage, coordinate data and weight data from an input operation made byanother user using the writing tool, and

in which the controller is capable of

-   -   controlling the display section to display, based on the        detected coordinate data and weight data, a second image that        shows a trajectory from a start to an end of the input operation        of the another user while superimposing the second image on the        first image,    -   comparing the stored coordinate data and weight data with the        coordinate data and the weight data detected from the input        operation of the another user, and    -   controlling the display section to display information        indicating a difference between the first image and the second        image.

-   (10) The information processing apparatus according to (9) above,

in which the controller changes a line width or shading of the firstimage and the second image according to the stored weight data and theweight data detected from the input operation of the another user.

-   (11) The information processing apparatus according to any one    of (1) to (10) above,

in which the sensor is capable of detecting, when a hand of the usertouches the input surface at a time the user makes the input operationusing the writing tool, coordinates of the contact position and a weightapplied to the contact position, and

in which the controller causes the storage section to store coordinatedata indicating the detected coordinates of the contact position andweight data indicating the weight applied to the contact position inassociation with the coordinate data and the weight data, that have beendetected from the input operation, and the identification information.

-   (12) The information processing apparatus according to any one    of (1) to (11) above, further including

a communication section,

in which the controller controls the communication section to transmitthe stored coordinate data and weight data to another informationprocessing apparatus, and

in which the another information processing apparatus displays an imagethat shows a trajectory from a start to an end of the input operation ofthe user based on the transmitted coordinate data and weight data.

DESCRIPTION OF REFERENCE NUMERALS

-   1 sensor-   2 sensor IC-   3 CPU-   4 memory-   5 graphic driver-   6 display-   100 tablet computer-   110 first surface-   150 input apparatus

The invention claimed is:
 1. An information processing apparatus,comprising: a sensor that includes an input surface for accepting aninput operation of a user using a writing tool and is capable ofdetecting: first coordinates of a first contact position at which theinput operation is made and a first weight applied to the first contactposition; and second coordinates of a second contact position where ahand of the user touches the input surface at a time the user makes theinput operation using the writing tool, and a second weight applied tothe second contact position; a storage section; and a controller capableof: causing the storage section to store, at selected time intervals:first coordinate data indicating the detected first coordinates andfirst weight data indicating the first weight, wherein the firstcoordinate data and the first weight data are stored in association withidentification information of the user; and second coordinate dataindicating the detected second coordinates and second weight dataindicating the second weight, wherein the second coordinate data and thesecond weight data are stored in association with the first coordinatedata, the first weight data, and the identification information; andreading out the stored first coordinate data and first weight data fromthe storage section in association with the identification information.2. The information processing apparatus according to claim 1, whereinthe controller is capable of calculating movement velocity dataindicating a movement velocity of the first coordinates from the firstcoordinate data stored at the selected time intervals.
 3. Theinformation processing apparatus according to claim 1, wherein thecontroller is capable of calculating weight change data indicating atemporal change of the first weight from the first weight data stored atthe selected time intervals.
 4. The information processing apparatusaccording to claim 1, wherein the input operation comprises a firstinput operation, and wherein the controller is capable of comparingthird coordinates and a third weight detected from a second inputoperation made using the writing tool after the first coordinate dataand the first weight data are stored, with the stored first coordinatedata and first weight data and judging whether there is a difference. 5.The information processing apparatus according to claim 4, wherein thecontroller is capable of authenticating the user based on the judgmenton whether there is a difference and outputting an authenticationresult.
 6. The information processing apparatus according to claim 5,further comprising a display section, wherein the controller is capableof controlling the display section to display, based on the inputoperation, an image showing a trajectory from a start to an end of theinput operation using only the first coordinate data out of the firstcoordinate data and the first weight data.
 7. The information processingapparatus according to claim 4, further comprising an output section,wherein the controller is capable of controlling the output section tooutput information indicating the judged difference.
 8. The informationprocessing apparatus according to claim 1, further comprising a displaysection, wherein the controller is capable of controlling the displaysection to display, based on the stored first coordinate data and firstweight data, a first image that shows a trajectory from a start to anend of the input operation of the user.
 9. The information processingapparatus according to claim 8, wherein the input operation comprises afirst input operation, wherein the image comprises a first image,wherein the sensor is capable of detecting, after the display of thefirst image, third coordinate data and third weight data from a secondinput operation made by a second user using the writing tool, andwherein the controller is capable of: controlling the display section todisplay, based on the detected third coordinate data and the thirdweight data, a second image that shows a trajectory from a start to anend of the second input operation of the second user while superimposingthe second image on the first image; comparing the stored firstcoordinate data and first weight data with the third coordinate data andthe third weight data detected from the second input operation of thesecond user; and controlling the display section to display informationindicating a difference between the first image and the second image.10. The information processing apparatus according to claim 9, whereinthe controller changes a line width or shading of the first image andthe second image according to the stored third weight data and the thirdweight data detected from the second input operation of the second user.11. The information processing apparatus according to claim 1, furthercomprising: a communication section; wherein the controller controls thecommunication section to transmit the stored first coordinate data andfirst weight data to another information processing apparatus; andwherein the another information processing apparatus displays an imagethat shows a trajectory from a start to an end of the input operation ofthe user based on the transmitted first coordinate data and first weightdata.
 12. An information processing method, comprising: detecting, by asensor including an input surface for accepting an input operation of auser using a writing tool, first coordinates of a first contact positionat which the input operation is made and a first weight applied to thefirst contact position; detecting, by the sensor, second coordinates ofa second contact position where a hand of the user touches the inputsurface at a time the user makes the input operation using the writingtool, and a second weight applied to the second contact position;storing, by a storage section, at selected time intervals: firstcoordinate data indicating the detected first coordinates and firstweight data indicating the first weight, wherein the first coordinatedata and the first weight data are stored in association withidentification information of the user; and second coordinate dataindicating the detected second coordinates and second weight dataindicating the second weight, wherein the second coordinate data and thesecond weight data are stored in association with the first coordinatedata, the first weight data, and the identification information; andreading out the stored first coordinate data and first weight data fromthe storage section in association with the identification information.13. A computer-readable storage medium having stored thereoninstructions that, when executed by at least one processor, perform amethod for information processing, the method comprising: detecting, bya sensor including an input surface for accepting an input operation ofa user using a writing tool, first coordinates of a first contactposition at which the input operation is made and a first weight appliedto the first contact position; detecting, by the sensor, secondcoordinates of a second contact position where a hand of the usertouches the input surface at a time the user makes the input operationusing the writing tool, and a second weight applied to the secondcontact position; storing, by a storage section, at selected timeintervals: first coordinate data indicating the detected firstcoordinates and first weight data indicating the first weight, whereinthe first coordinate data and the first weight data are stored inassociation with identification information of the user; and secondcoordinate data indicating the detected second coordinates and secondweight data indicating the second weight, wherein the second coordinatedata and the second weight data are stored in association with the firstcoordinate data, the first weight data, and the identificationinformation; and reading out the stored first coordinate data and firstweight data from the storage section in association with theidentification information.
 14. The information processing method ofclaim 12, further comprising: calculating movement velocity dataindicating a movement velocity of the first coordinates from the firstcoordinate data stored at the selected time intervals.
 15. Theinformation processing method of claim 12, further comprising:calculating weight change data indicating a temporal change of the firstweight from the first weight data stored at the selected time intervals.16. The information processing method of claim 12, wherein the inputoperation comprises a first input operation, and wherein the methodfurther comprises: comparing third coordinates and a third weightdetected from a second input operation made using the writing tool afterthe first coordinate data and the first weight data are stored, with thestored first coordinate data and first weight data and judging whetherthere is a difference.
 17. The computer-readable storage medium of claim13, wherein the method further comprises: calculating movement velocitydata indicating a movement velocity of the first coordinates from thefirst coordinate data stored at the selected time intervals.
 18. Thecomputer-readable storage medium of claim 13, wherein the method furthercomprises: calculating weight change data indicating a temporal changeof the first weight from the first weight data stored at the selectedtime intervals.
 19. The computer-readable storage medium of claim 13,wherein the input operation comprises a first input operation, andwherein the method further comprises: comparing third coordinates and athird weight detected from a second input operation made using thewriting tool after the first coordinate data and the first weight dataare stored, with the stored first coordinate data and first weight dataand judging whether there is a difference.